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A study evaluated the effectiveness of a series of 
print materials and interactive computer-guided study programs 
designed to lead undergraduate students to apply basic textbook 
reading and concept mapping strategies to tne study of science and 
social science textbooks. Following field testing with 25 learning 
^skills students, 50 freshman biology students enrolled at Indiana 
University were divided into treatment and control groups. Both 
groups read two 7-10 page biology textbook selections. Treatment 
students scheduled three weekly one-hour appointments using the 
computer programs, which helped students identify key concepts^ write 
summary statements comparing and contrasting concepts, and 
graphically map relationships among concepts. After each lesson 
students answered a questionnaire on the usability of the lesson, and 
on completion of the last lesson, chapter examinations were given 
along with an open-ended questionnaire evaluating the program. One 
week after the chapter exam, treatment subjects read a new biology 
text and were given an exam on the new material. Control students 
were provided only with the text and completed the same examination 
taken by the treatment group. They also returned one week later to 
repeat the process with the new text. Findings showed that treatment 
students significantly outperformed control students for both texts 
in ability to link terms and map concept relationships. Questionnaire 
data indicated that computer instruction was viewed positively as a 
way to learn strategies for reading difficult material. (Two tables 
of data are included, and 23 references are appended.) (MM) 
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Most beginning undergraduate students have the basic reading skills 
needed to unde'r^stand a newspaper (Applebee, Langer & Muilis, 1985), but 
many of these students have difficulty reading and studying college 
textbooks^ Cahalan and Farris (1986) report that 82% of all institutions 
of higher education and 94% of public institutions offer remedial courses 
to college undergraduates. The National Center for Educational Statistics 
reports that 25% of tindergraduace students seek scxoe fom of remedial help 
with university-level study problems This problem of undergraduates 
inadequately prepared to cortprehend university-level material is even 
greater at smaller corrmunity colleges and open admission schools • Seventy- 
five per cent of students at two-year cind open-admissions colleges are 
enrolled in remedial courses ("College remedial," 1985). 

Techniques for iirproving undergraduate reading and study skills often 
involve instructors modeling for students cognitive and metacognitive 
strategies for identifying key ideas and relating ideas to form meaningful 
structures. , The premise of the research reported in this paper is that an 
interactive cotrputer program can model and guide undergraduate students 
through some of the iicportant cognitive and metacognitive processes of 
reading college textbook chapters in such a way that: 1) coirprehension of 
the modeled chapters is increased and 2) students are able to transfer the 
processes to new, unmodeled chapters effectively. 

This manuscript reports phase one results of a two-year project funded 
by the Fund for the Irrprovement of Postsecondary education (FIPSE) This 
research and developnnent project is designed to develop and evaluate the 
effectiveness of a series of print materials and interactive carputer- 
guided study programs which lead undergraduate students to apply basic 
textbook reading strategies and conce',>t mapping strategies to the study of 
science and social science textbooks. The materials and coirputer programs 



are designed to guide and help ntudents: 

* Identify key concept? in textbook chapters, 

* Ccirpare, contrast, and connect ideas by writing linking 
stfltinary statements , and 

* Synthesize and graE^iically map relationships among key 
concepts • 

Reading Abilities and Demands of Entering Undergraduates 

Over 56% of 17-18 year olds go beyond hi.gh school to some form of 
post-secondary education. The percentage of students that enter colleges 
and uxxiversities is less clear due to differing definitions of what 
constitutes a college, but remains in the 40-50% range (Lisack & Shell, 
1985) • 

Though cotiplete data i:^n the reading abilities of under-gradiaates 
does not exist. National Assessment of Educational Progress (N.A.E.P.) 
reading test results for 17-year-olds (^^lebee, Langer & Muliis, 1985) 
allow us to draw inferences about the reading abilities of adolescents who 
enter colleges and J.versities. N.A.E.P. results for 1984 indicate that 
only 39.2% of 17-year-olds demonstrated adept corrprehension strategies 
(able to find, understand, simmarize, and explain relatively ccxrpxicated 
information) . Furthenrore, only 4.9% attained an advanced level of 
strategy use (able to extend and restructure ideas in specialized texts). 
With current ac!missions in post-secondary education close to 50% of 17-18 
year-olds, one can expect a significant number of undergraduates to have 
difficulty coitprehending relatively conplicated textbook material and a 
itajority to have difficulty restructuring and extending ideas from such 
specialized texts. 

Several researchers have identified and characterized weaknesses that 
differentiate less coirpetent readers frcxn their more capable counterparts. 



Such readers are likely to have gaps in Icnowledge, have an impoverished 
understanding of relationships among facts, and are unlikely to mal^:e the 
inferences required to weave the text into a coherent whole (Bransford, 
Stein, Nye, Franks, Auble, hierynski, 6c Perfetto, 1S82). Less able readers 
tend to use a listing rather than a structure strategy because they 
perceive all content as equally iirportant. (Meyer, 1984b; Meyer, Brandt & 
Bluth, 1980; Msyer & Rice, 1982). 

Structure Awareness, Concept Mapping and Improved Reading 

The results of several studies suggest that stixlents who are aware of 
the structure of expository materials are able to outperform students who 
are not aware of text structure (McGee, 1982a; McGee, 1982b; tteyer, Brandt 
& Bluth, 1980; Taylor, 1980; and Taylor & Samuels, 1983). In addition, 
readers who are actively involved in constructing a structured 
representation of what they have, lead do better than their counterparts in 
recall performance (Arnibruster & Anderson, 1980; Slater, 1982; Berkowitz, 
1986; and Danner, 1976). Some researchers examining the effectiveness of 
having students graphically depict the relationships among major concepts 
in text (concept mapping) have found carry-over benefits to related 
language activities. Ruddell and Boyle (1984) found that stixlents who used 
concept mapping as a pre-writing exercise were able to write longer / higher 
quality essays than their counterparts. Geva (1983) found stxidents who 
were taught to map or flowchart their understanding of expository material 
not only improved in mastery of tlie mapped material/ but also improved in 
general reading ability as measured by a standardized reading test. 
Role of Modeling and Computers 

The modeling of cognitive processes has been suggested by several 
researchers and educators as a method for clarifying to less able readers 
methods of thought while reading (Brown/ 1980; Davey, 1983; anith & Dauer/ 



1984). Suggested techniques usually incorporate explication of the 
techniques being inodeled, modeling of strategies and techniques to be used, 
and then student practice and feedback. 

An instructional fomat for effective cortputer-assisted instruction 
has been -(ieveloped by Alessi and Trollop (1985). This format also includes 
1) explication of the coi"icepts, 2) modeling of the strategy, 3) practice 
and feedback, and 4) assessment and branching. 
Rationale of Study 

Large percentages of undergraduate students seek aid in meeting the 
reading demands of .college. It is likely that even larger percentages are 
in need of such aid. Interactive cai^ter programs may be able to help 
meet this need if they can effectively model and instruct students in 
cognitive and metacognitive reading strategies shown by existing research 
to be effective. This study assesses the utility and effectiveness of 
three interactive corrpiter programs and as-sociated print materials in 
instructing and modeling for undergraduates how to caiprehend and 
reconceptualize scientific textbook material. In addition to formative 
evaluation, the programs were evaluated by cocrparing the iinnediate and 
delayed post-program perfornance on textbook chapter tests of a treatment 
groijp of 25 biology students to the performance of a matched control groi:^) 
of 25 biology students. Post-program questionnaires and interviews given 
to treatment groi^) students assessed student evaluation of coirputer program 
effectiveness . 

METHOD 

Subjects 

The biology textbook cc«rpiter programs and associated print ui.*^ in 
this study were field tested with the aid of 25 undergraduate students 



enrolled in Learning Skills courses at Indiana University. Formative 
evalxaations exandned program clarity, usefulness, and student attitudes 
toward the programs. Responses from students were used to refine and debug 
early versions of the materials and computer programs. 

After the refinements had been made, 50 second semester freshman 
volunteer biology students ( 34% male and 66% female) who received class 
credit for participation were divided into treatment and control grou^^s 
matched on SAT verbal scores, high school rank, and university grade point 
average (4.0 scale). 
Student averages follow below. 





N 


SATV 


GPA 


H.S. Rank 


Treatment 


25 


422 


2.65 


26.8 % 


Cbntrol 


25 


426 


2.64 


27.8 % 



Imitruments and Materials 

Textbook Passages: Both treatment and control stiodents read two 7-10 
page selections from the embryonic devi^lopcnent chapter and tb^ blood 
corposition chapter of Elements of Biological Scif nee (Keeton & McFadden, 
1983) . These selections and this text were selected with the aid of 
biologist. Dr. Albert Ruesink, as topics, text formats, and difficulty 
levels typical of most college level introductory biology texts. 

Coirputer Programs: Three 30-40 minute ccicputer programs were designed 
to follow biology text material dealing with embryonic development. The 
programs modeled for students how to 

1) identify key concepts within a text/ 2) write linking suinaary statanents 
which coitpare and contrast key concepts , and 3) graphically map 
relationships among key oonc^Jts. 

The instructional format of the programs is adapted from Alessi and 
Trollop's (1985) suggestions for effective CAI. They include 1) 



explic=ition of the concepts, 2) modeling of the strategy, 3) practice and 
feedback, and 4) assesan>ent and branching. 

- The Explication segments (generally at the beginning of 
each section) include a strong rationale and statement of 
purpose for the activity, as well as suggestions for 
transfer to the performance environment* 

- Modeling is interspersed throughout the program and 
generally consists of a combination of exairples and, when 
warranted, informative feedback. 

- Students are required to Practice each step or group 

of steps to mastery before moving on through the program. 
Practice is set up in incremental steps to provide early 
success and reinforce each e::^sential step in performing 
the strategy. 

- Feedback is established as effective in CAI and the 
efficacy of feedback is proportional to its quality. 
Feedback in this program always includes knowledge of 
results and knowledge of correct response with feedback 
appropriate to the student's response — what mistake he 
or she is likely to make, where to look for information 
to self -correct, and how to avoid that error in the 
future. 

- Answer judging always provides feedback, but sometimes 
includes interactive teaching if the student .fails on a 
significant number of tries to produce a correct response. 
In these cases the program will Assess student performance 
and branch the user to remediation before returning the 
student to the question segment for another try. 

Locus of control is offered to the students whenever possible. At 
least once in each program, students can opt for an "Exercises Only" or an 
"Explanation plus Exercises" fonrat. This choice allows the student to 
determine the level of detail in which the instruction is presented. If 
the student who chooses "Exercises Only" has perfonnance problems, he or 
she is automatically branched to the "Explanation plus Exercises" section. 

The screen design follows well-established parameters for document 
design with appropriate modification for the screen and for the target 
population. For exarcple, each screen contains a proitpt at the bottom of 
the screen that tells the student exactly what he or she needs to do to 
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move through the program. Content-related direction lines are often 
contained in the text. 

Becaixse of the students' teiiC'^«cy to miss the relationships between 
ideas, screens are designed to interlock concepts so that related concepts 
are presented together on the same screen and the relationship is 
elaborated upon to make it more specific. Relationships are presented 
visually at every opportimity. 

Students also are given a strong advance organizer at the beginning of 
each segment to tap into existing background knowledge and to set up a 
framework for the lesson. Each lesson section is introduced with a 
consistently-colored screen. When the user is in a section of his or her 
choosing, a small box in the upper left hand comer serves as a guide to 
the macrostructure. 

Chapter Exams: Textbook chapter examinations were developed to test 
the ability of students to identify key ideas in t/ixtbook chapters, coi^are 
and contrast these ideas, and accuraT:cly depict relationships among key 
ideas. Parallel examinations were developed and field tested for the 
embryonic developnent chapter and the blood corrposition chapter. 

To field test tliese measures, two classes (40 students) at the Indiana 
University Learning Skills Center read and took tests on the biology 
chapters. Class 1 read the embryonic text first and the blood text second; 
class 2 reversed the process by reading the blood text first and the 
eitibryonic text second. The chapter examinations were administered to both 
groi:5)s after each text was read. Mean scores (fran a possible 100 points) 
were similar for the two tests (Eitfcryo, 60.7; Blood, 61.9). Clear--cut 
scoring guidelines were developed and used to attain an inter -rater 
reliability correlation of r = .95 for the two raters scoring the tests 



Monitoring of inter-rater reliability using a 25% sanple of later treatment 
and control subjects revealed correlations of r = .91 for the embryonic 
chapter test and r = .96 for the blood chapter test. 
Procedures 

The treatinent group was notified by letter to schedule three one-hoiu: 
appointments a week apart and corrpleted one lesson each week during the 
last three weeks of March. After each lesson the students were asked to 
answer a short questionnaire on the usability of the lesson. On completion 
of the last le.:;r^n, the chapter examinations were given along with an open- 
ended questionnaire about the program and its usefulness in biology and in 
other courses. One week later students were asked to again return to the 
Learning Skills Center and to read a new biology text (blood text) and to 
cocrplete a chapter examination. 

The control groi:^) was also contacted by letter and asked to schedule a 
one-hour appointment during which they were provided with only the text 
(embryonic text) and asked to read it without the help of the computer and 
to cocrplete the same examination that had been taken by the treatment 
grot^). They also returned one week later to repeat the process with the 
new text (blood text) . 

RESULTS 

Chapter Examination Results 

The chapter examinations were administered in order to determine the 
effectiveness of computer programs in modeling and teaching strategies for 
comprehending college-level textbooks. The treatment group had instruction 
on the computer while using the embryonic textbook chapter and was tested 
immediately after program completion. The blood composition chapter was 
read and tested upon one week iater. The control groiip/ during two sittings 
one week apart, read and were tested upon the two texts. 

ERIC iO 



The treatxnent groi:?) scored significantly higher on both the enibryonic 
and the blood chapter exams. The control groi^) averaged 62.89 out of a 
possble 100 points on each chapter examination while the treatment group 
averaged 79.73 out of a possible 100 points on each examination. Results 
are displayed in Table I. 



Insert Table I. 

It was predicted that the con^wter program use would result in higher 
scores for the treatment group on the embryonic test since that was the 
text used in the conpater lessons. Of greater educational significance is 
the result that the treatment group also significantly outperfonrvad the 
contz-ol group a week later reading the blood text without aid of the 
computer programs,, suggesting transfer of the reading strategies beyond the 
single chapter covered in the cotrputer programs. 

. Further analysis was undertaken on scores for subsections of the 
chapter examinations to detemine which strategies were learned most 
effectively. Results are displayed in T^le II. 



Insert Table II. 



Significant differences in the treatmsnt group's favor at the p < .05 
level or better exist for all subsections except the identifying key 
concepts section of the blood cocnposition chapter. Even in this case, the 
treatment group scored 92% of possible points while the control gtovp 
scored 84% of possible points. 
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Biology class test> An iinplanned indicator of program succc^ss is the 
fact that treatment group students outperformed control groi^) students on 
items related to embryonic development on their biology clas? test which 
was not a part of this study • On questions related to embryonic 
development, the treatment averaged 94% correct while the control grot^ 
averaged 72% correct. 
Interview cind Questionnaire Results 

At tl<e end of each lesson , the treatment group was asked to complete a 
LiKert scale to ascertain student opinions of the effectiveness of the 
computer in developing basic skills for cocrprehending a biology text. The 
scale ranged from 5 (Strongly Agree) to 1 (Strongly Dis^i^ree). Mean 
results for the three cotrputer lessons ranged frocr, 4*20 to 4.60. Students' 
attitudes toward the programs were strongly positive with no significant 
differences in relation to sections of the programs. 

The lessons we*-e also judged to be effective by the 25 students who 
used the programs. Student cocrments during exit interviews included: 
"I hadn't thought of that before." 

"I wish they had these for try brother in high school." 
"Everything is "clear about what you're supposed to do." 
"I enjoyed the lesson. It's like X151 without the 
extra work." 

"Ohf my god, I totally skip over drawings* 
"^1 wish I'd learned to stucfy a text before I got to 
college." 

"Have you had success with these programs? They seem 
very good." 

At the end of lesson III students were asked to complete an open-ended 
questionnaire concerning the entire program. Among the questions asked of 
stiKients was: Have you ever before used the ideas presented in the 
computer • * tor 

Yes No 

a. loci ins? 19 5 
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b. coit^re and contrast key terms? 13 11 

c. nap relationships among key terms? 3 21 

For the vast majority of students in the treatinent group, grafAiically 
mapping concepts was a new and unfamiliar task. In addition, corrparing and 
contrasting key terms was also •only reported as familiar by 54% of the 
students. 

In answer to the question: "Has your ability to understand text 
material iirproved?", twenty-one students (87.5%) answered "yes". Students 
answering yes were asked to expand upon the ways they thought their 
abilities had irrproved. Among the elaborations provided are: 

- My biggest problem is fitting concepts together. Now I 
have a better feel about how to do it. 

- Again/ through organizations of materials. Now I have a 
structured method of study. 

- Most of these ideas were already familicir to me, but using 
the lessons on the coroputer showed how advantageous these 
ideas are for learning text material. 

- It takes a little more time to try and do the things you 
have learned (locating and coitparing) but the benefits 
make it worth it. 

- By learning to link key terms together and being better 
able to see the whole chapter made up of its smaller 
parts. 

In an atternpt to determine whether or not the students could see a 
transfer of the skills presented on the coitputer to other courses at the 
university, treatment group stiodents were asked, ''In what ways, if any, 
will this lesson be useful for other courses in vMch you are enrolled?" A 
sarople of cortments follows: 

- You can apply all the concepts of the experiment to other 
courses with maybe the exception of math. 

- Yes for sociology, etc., but not for English classes, esp. 
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literature. 

- In alinost all of ray subjects, textbooks are used and set 
up in the same format. I hope to apply concepts learned 
to various areas. 

- The ideas of locating key terms, ccxiiparing and con- 
trasting, and mapping can all be used in other courses. 

- Other courses v^iere there is lots of reading involved 
such as my Human Development class which deals with many 
of the same concepts presented here. 

CC^CLUSIC»5S 

With funding from F.I.P.S.E., the Learning Skills Center at Indiana 
University has developed a series of cc«Tnputer lessons to help students 
catprehend college level text material. Using guidelines for effective CAI 
and research on reading cotprehension, the carputer programs model study 
strategies and concept mapping while providing for practice and feedback. 

Significant differences in examination results support the hypothesis 
that "how to" strategies can be taught with the use of a cocrputer. The 
treatment students outperformed the control students at a statistical p < 

from the corrputer programs to the blood text also at a p < .001 level. 
Significant differences in favor of the treatment group were also 
consistently found for both texts in abilty to link terms and concept map 
relationships. Concept mapping was reported to be a new concept by 87.5% 
of the treatment group. , 

Interview and questionnaire data iiidicate that corrputer instruction is 
viewed positively by students as a way to learn strategies to read 
difficult material . Indications were that 1 ) the programs were user- 
friendly, 2) the strategies were new and useftil, 3) the ability to 
understand text material had improved, and 4) study strategies transferred 
to use with new textbook chapters. 

At a time when many students are enrolling in postsecondary 
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institutions without the necessary skills to meet required stu<^ 

and reading demands, the carputer can be a useful tool to teach effective 

strategies. The Learning Skills Center is presently developing similar 

software for psychology texts that wilj. be field tested in the spring of 

1988. 



For inf onnation on how to obtain Using Your Biology Textbook Effectively , 
the software discussed in this paper, contact: 

Dr. Larry Mikulecky, Director or 

Rad DrcMr C.A.I, coordinator 

Learning Skills C^ter 

316 N. Jordan 

Indiana University 

Bloomington, IN 47405 

Telephone: (812) 335-7313 

Bitnet: MIKDLK:k@IUBACS or DREWRQIUBACS 

Other software developed at the Indiana University Learning Skills Center 
includes: Using Your Psychology Textbook Effectively , Textbook Marking , 
Testtaking , and Tme Managerftent o 
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Table I. 



Mean Score Dif fererK:es 
of Treatment and Control Siahjects 
on Embryonic and Blood Chapter Examinations 



Treatment Control 

n=25 n=:25 

Etabryonic Chapter Exam 79.86 61,92* 

Blood Chapter Exam 79 ,59 63,86* 

* Differences significant at the p < ,001 level 
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Table II. 



Mean Sub-Scale Score Differences 
of Treatment and Control Subjects 
on Embryonic and Blood Chapter Examinations 



Ehibryonic Exam 

Identifying Key 
Concepts 

Linking Key Terms 

Mapping 
Relationships 



Treatment 
n=25 

18.6 
17.3 

44.0 



Control 
n=:25 



Sia 
Level 



15.2 (20 possible) .001 

15.3 (20 possible) .05 

31.5 (60 possible) .001 



Blood Parts Exam 

Identifying Key 

Concepts 18.4 

Linking Key Terms 18.8 

Mapping 

Relationships 42.1 



16.8 (20 possible) N.S. 
13.8 (20 possible) .001 

33.2 (60 possible) .01 
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